Aggregation and disaggregation in Markov decision models for inventory control
نویسندگان
چکیده
AGGREGATION AND DISAGGREGATION IN MARKOV DECISION MODELS FOR INVENTORY CONTROL
منابع مشابه
Approximate Disaggregation{aggregation Solutions for General Queueing Networks
An approximate disaggregation{aggregation technique for nite state Markov chains is applied to queueing networks with diierent service disciplines, Coxian service and interarrival time distributions, blocking, and synchronization. Large Models with many states can be solved, so large that the state probabilities could neither be stored nor calculated in any computer. Accurate approximations are...
متن کاملFinding Steady States of Communicating Markov Processes Combining Aggregation/Disaggregation with Tensor Techniques
Stochastic models for interacting processes feature a dimensionality that grows exponentially with the number of processes. This state space explosion severely impairs the use of standard methods for the numerical analysis of such Markov chains. In this work, we develop algorithms for the approximation of steady states of structured Markov chains that consider tensor train decompositions, combi...
متن کاملGeneral Dynamic Programming Algorithmsapplied to Polling
We formulate the problem of scheduling a single server in a multi-class queue-ing system as a Markov decision process under the discounted cost and the average cost criteria. We develop a new implementation of the modiied policy iteration (MPI) dynamic programming algorithm to eeciently solve problems with large state spaces and small action spaces. This implementation has an enhanced policy ev...
متن کاملUsing Simulation to Evaluate a Continuous Review (r, Q) Two-echelon Inventory Model
The effective management of supply chains depends upon the ability of decision makers to control inventory while maintaining customer service at low cost. This paper examines an analytical model for the two-echelon one warehouse and multiple retailers system using (R, Q) inventory policies. A simulation model was developed to analyze the performance of the analytical model under conditions that...
متن کاملOptimality Inequalities for Average Cost Markov Decision Processes and the Stochastic Cash Balance Problem
For general state and action space Markov decision processes, we present sufficient conditions for the existence of solutions of the average cost optimality inequalities. These conditions also imply the convergence of both the optimal discounted cost value function and policies to the corresponding objects for the average costs per unit time case. Inventory models are natural applications of ou...
متن کامل